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ABSTRACT 



This paper describes and evaluates the design process 
involved in creating a single problem for online delivery in a problem-based 
learning (PBL) situation. The paper attempts to highlight the issues involved 
with implementing the problem in a completely distributed environment through 
a narrative about the design of the problem within an instructional design 
model. The problem was developed for a graduate -level course titled 
"Integrating the Internet across the Curriculum." The Theoretical Model for 
the Design of Open-Ended Learning Environments (OELE) (J. Hill and S. Land, 
1998) was used, and following this model, the first steps were analyses of 
the environment and the participants. Goals were defined, with the PBL 
approach chosen to provide students with a rich opportunity to explore 
elements of technology integration. The selection of delivery media was 
easier because of the researchers' access to an asynchronous conferencing 
tool that had been developed to support PBL in a distributed environment. The 
one area of OELE that was different for this delivery was the inclusion of 
all course supporting material on the Web site. The design phase concluded 
with the development of an evaluation plan and a plan for maintenance of the 
online PBL experience. (Contains 23 references.) (SLD) 
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Designing a PBL Experience for Online Delivery in a Six-Week Course 

Chandra Hawley Orrill 

One of three papers presented in (structured poster) Session 12.02, Problem-Based Learning in 
an Online Instructional Technology Course , at the annual meeting of the American Educational 
Research Association, New Orleans, April 25, 2000 

The move toward an information age curriculum focused on higher-level thinking, hands- 
on experience, and the process of learning instead of the products of learning is becoming the 
focus of many calls for change in higher education (e.g., Boyer Commission, 1998). Such calls 
often look to problem-based, project- based, or action- based learning as potential cures for our 
ailing system. Problem-based learning (PBL), as one solution, offers a considerable amount of 
promise as a potential instructional focus as it asks learners to take on real problems, use real 
resources, and develop real answers to the kinds of complex, ill-structured problems that people 
face every day (Savery & Duffy, 1995). Further, problem-based learning seems to Fit into the 
new technology-based model for higher education. It is adaptable for on-line delivery, benefits 
from the wealth of information available from the Internet, and requires the communication 
afforded by email and conferencing tools. Further, problem-based learning supports collaborative 
learning even at a distance. 

The goal of this paper is to capture the design process involved in creating a single 
problem for online delivery. Further, the paper attempts to highlight the issues involved with 
implementing the problem in a completely distributed environment. In order to do this, a 
narrative about the design of the problem will be provided within an instructional design model. 

Implementation will be discussed both from the perspective of our own case and from the 
perspectives of others who have had similar experiences. 
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The focus of this paper is a graduate-level course entitled “Integrating the Internet Across 
the Curriculum” that was offered in the summer of 1999. The course was team-taught by two 
instructors (Orrill & Kirkley) who had each previously taught the course alone previously. Orrill 
(the author of this paper) had taught the course two times during the 1998-1999 academic year 
and Kirkley had taught it three semesters during the 1997-1998 academic year. This was the first 
time the course had been co-taught and the first time that either of us had taught any course 
together. The instructors, however, did have extensive experience working together on research 
and development projects. This was also a distributed teaching experiment of sorts in that the 
instructors were in different states for the duration of the course. 

The course had traditionally been offered during the full 16 week semester, but for this 
offering it was limited to just under six weeks. This meant that we were forced to critically 
examine everything we had done previously for the course as well as critically evaluate our 
goals. This also meant examining the previously used PBL unit to see how, or if, it fit into the 
redefined course. 

Designing Problems 

Thanks to the efforts of many people in a variety of settings from business schools to K- 
12 classrooms, we have learned a lot about how to design problems, implement them in our 
classrooms, evaluate learning, and facilitate in problem-based learning environment (e.g., 
Barrows, 1985; University of Delaware, 1999; Savery & Duffy, 1995; Stepien & Pike, 1997; 
Stinson & Milter, 1996; Torp & Sage, 1998). However, we are now faced with a double 
challenge in higher education. In addition to responding to the imperative to build more learner- 
centered environments such as those promoted in the problem-based learning classroom, we are 
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also being challenged to move these learning experiences online in order to reach a wider 
audience. 

Some research and opinion is beginning to emerge that specifically discusses effective 
ways to teach and learn in distributed environments (e.g., Hillesheim, 1998). However, there is 
still much that is not known. For instance, Brittain, Chambers, and Marriott ( 1998) offer a 
synthesis of “Current Best Practice Criteria for Digital Learning Design” which offers some 
guidance - and advocates the use of a PBL approach, but it suffers from generality. They point to 
many of the key issues such as the importance of the facilitator/leamer relationship and the need 
to frame the problem in the learner’s life context. However, they do not focus on how to do these 
things - or what they look like when they are done well. 

Likewise, Wegner, Holloway, and Crader (1997) offer a picture of what their course in 
education looked like when offered using web-based, problem-based learning. Based on our 
experience, the conclusions of this single case study were thoughtful and accurate, but focus on 
what we already know about PBL: the facilitator needs to ask questions or the students will 
become lost. Wegner et al did add a couple very specific findings to our understanding of online 
PBL, however. One major point they raise is that the students may require more or different 
structuring than the pure PBL models typically call for. For instance, in their case, they felt it 
necessary to provide “springboard” questions in order to ensure that students focused on the 
content areas they felt were most important. They also found that while their students (advanced 
undergraduates) liked the PBL approach, they were mixed in their reaction to the use of 
technology (video conferencing, email, and Internet searches for information). They also noted 
that the students indicated an interest in using Internet-based technologies for communication. 
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In an effort to fill in some of the gaps that stand between face-to-face implementation and 
on-line implementation of PBL, this paper will examine our course in two ways. First, using the 
Theoretical Model for the Design of Open-Ended Learning Environments (OELE) (Hill & Land, 
1998), is a description of our design process for the problem and the specific questions we faced 
in creating this problem. Next, is an examination of our implementation. For this section, the 
focus is not only our single case, but also an examination of the experiences and beliefs of others 
in order to highlight the key implementation issues involved with the development and delivery 
of online PBL. 

Hill and Land’s OELE Model 

The OELE model (Hill & Land, 1998) offers an appropriate framework for considering 
the design of PBL environments - for online or face-to-face delivery. Hill and Land describe an 
open-ended learning environment as one that: 

• Uses meaningful and complex contexts in an effort to “mirror the holistic thinking 
practices of experts, within the boundaries accessible to novice learners” (p. 168). 

• Provide tools and resources to facilitate students’ work or provide the opportunity for 
students to construct their own resources to help develop their understanding. 

• Require learners to be reflective and self-monitoring. In fact, according to Hill and Land, 
“OELEs often require the creation of end-products that make learner-reasoning overt” (p. 
169). 

• Use teacher-learner, leamer-leamer, or technology-learner scaffolding techniques to 
support the students at their own level. 

By this description, PBL certainly qualifies as an open-ended learning environment and the 
design of PBL situations, in our experience, falls nicely within the model proposed by Hill and 
Land. 
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Figure 1: Hill & Land’s Theoretical model for the design of OELE’s 



Analysis 



Design 



Development 



Maintenance 



implementation 



Evaluation 



Analysis 

Our first step was to analyze the situation we were dealing with, who our learners were, 
and what goals we had for them. The OELE model puts considerable weight on this phase. It 
recommends that we examine our environment and our participants. For us, these two parts 
worked together - offering a full picture that helped guide us through the process of developing 
the problem. 

Environmental Analysis 

In evaluating our environment, defined as both the context in which the OELE will be 
implemented and the supporting environment for it, it became apparent to us that keeping the 
PBL focus was important. Our primary concern was helping the teachers who participated in this 
course to integrate the Internet into their classrooms in thoughtful, creative ways. We also had a 
hidden agenda of helping support teachers in moving toward teaching in the constructivist 
paradigm. 

We were adopting the “critical” viewpoint as defined in Hill and Land. We felt a need for 
our students (the teachers we worked with) to be aware of their choices and be able to make 



1 Recreated and used by permission. 
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decisions for themselves. It was this desire to promote a critical stance and to help students “see” 
the variety of options available that drove us to realize that keeping the PBL focus was critical. 

The reason for choosing to create an OELE and the structure of the environment were 
tightly tied to the philosophical stance adopted by both instructors. We were firmly committed to 
modeling the kinds of learning environments we wanted our students to create in their own 
classrooms. Further, we both strongly believe that learning is dependent on social interaction 
(Vygotsky, 1978), and were committed to the idea that the learners need to guide their own 
learning, particularly because of the brevity of the course and the immense body of material to be 
included in the learning experience. 

Participant Analysis 

The knowledge we had gained from teaching this course previously helped guide us in 
this activity in ways that were extremely valuable. First, it was easy for us to identify who our 
students would be. We hypothesized that the class would include full-time teachers and, perhaps, 
one or two full-time graduate students. We projected that the participants would vary 
tremendously in the level of technology experience, teaching experience, and personal 
philosophy. Finally, we assumed that the students would be from at least one country other than 
the U.S. Our projections proved to be quite accurate for this course. We had nine students, but 
one dropped out of the course after one week. Most were public school teachers - however, two 
were full-time graduate students at Indiana University and one was a home-schooler. Another 
student was licensed as a teacher but not practicing. One of the teachers worked in an 
international school Hong Kong and, during the course of this class, traveled between the U.S. 
and Hong Kong twice. 
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The second consideration in participant analysis in the OELE model is the role that the 
participants will play in the environment. This becomes an extremely important question in 
implementation. Again, our past experience really helped guide us on this issue. We adopted a 
stance in which the learner leads his or her own learning, but in which the instructor takes on a 
support role. We knew that we would want to bring in a set of resources, but knew the students 
were always free to find their own. We wanted to provide enough of a framework that the 
students would be able to negotiate the project management aspects of the PBL unit successfully. 
However, we did not specify an outcome for the problem or a format for turning it in, though the 
choices here were limited because of the problem requiring some form of report to the 
superintendent. 

Finally, we called on our prior experience in identifying the relevant characteristics of the 
participants. We knew that they would not be totally comfortable with technology, and in fact, 
that it would take some time just to work through the bugs involved with the start-up of the 
course. Because of this, we decided that the first week would be spent reading and discussing 
articles supporting different opinions about technology integration rather than starting with the 
PBL unit immediately. Further, we recognized that we would have to offer more support to 
certain students to help them feel more comfortable with the technology and with PBL. We 
designed the course with plans in place for dealing with these issues. Our primary intervention 
for any stated insecurity - about technology, content, or pedagogical approach - was to send 
supportive emails to participants. Further, before they began the PBL unit, we asked the students 
to read some introductory materials about PBL so that they would understand the process they 
were going to use. We felt this was particularly important because our students are teachers and 
should be aware of different pedagogical approaches. 
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Design 

As illustrated in the Hill and Land model, the stages of the ID process overlapped at 
every step. Even while we were deciding whether or not to use PBL, or any open-ended 
approaches, we were considering what our objectives were, and how we would implement the 
whole thing. This constantly overlapping and iterative process helped us to keep moving forward 
- using information from one stage to inform other stages. 

For the design stage, our first, and most important, challenge was to define what we 
wanted the students to learn. This initially began as two different lists - the first outlining topics 
we felt were important (Table 1), the second listing some approaches we might use to “cover” 
the areas. This stage, more than the first, benefited from having two instructors who were not 
only interested in the same outcomes, but also shared the same language. This made it easier for 
us to make these lists - knowing that we both deeply understood the issues and reasons behind 
each item. Without that experience, it is likely we would have needed further explanation of our 
intents. 



Table 1: Identified Goals for the Course 



Issues 


Applications 


Perspectives 

Rights & Responsibilities 
Issue Awareness 


Evaluation for sites 
Assessment 
T eachi ng/Integration 



After the lists were created, we went a step further, sectioning off the “applications,” such 
as evaluating websites, from “issues” like Internet rights and responsibilities. The PBL unit was 
kept because it allowed the most in-depth coverage of the issues we felt were most important. 
While in this phase we had only vaguely identified a problem area - having to write a grant for 
technology - we knew that this would require the students to consider issues of purchasing 
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equipment, planning professional development, dealing with sensitive issues such as protecting 
students from inappropriate materials, etc. However, we recognized that part of the students’ 
learning needed to include the opportunity to put theory into practice by creating something for 
their own classrooms. Therefore, we chose to spend a week and a half supporting our students in 
developing an Internet lesson plan as part of the larger course. Combined with the introductory 
week, these two activities took up two and a half of our course. This left three weeks for the PBL 
unit. 

As we worked in this phase, we often crossed into the development and implementation 
phases. We explored the potential consequences of mixing a variety of approaches, using only a 
few, removing the PBL component all together, etc. In the end, we decided on our approach 
based on the three areas covered in the “means of instruction” area of the OELE model. 

As already discussed, we felt that much of our content was best learned in a self-directed 
way. We chose the PBL model because it provided a realistic backdrop for the work and 
provided an extremely rich situation in which the students would be free to explore some 
different elements of technology integration. Further, we were attracted to the known benefits of 
PBL such as increasing critical thinking skills (Savery & Duffy, 1996). 

The selection of delivery media was an easier issue. We had access to an asynchronous 
conferencing tool (ACT) that had been developed to support problem-based learning in a 
distributed environment (Duffy, Dueber, & Hawley, 1999). 2 Further, both instructors had 
experience in using this tool to support meaningful conversations and were comfortable with 



2 It should be noted that while ACT was designed for these activities, it was a tool that had never been completed. 
Therefore, we had the main portion of the functionality originally called for in the design plan - the threaded and 
linear discussion aspects, but the other portion — the part that was to link the threaded discussion to the linear 
discussion, was never developed. Interestingly, this was partially due to the “clumsiness” of trying to move 
information around in a virtual environment. 
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structuring the discussion. In addition to ACT, we also had a course website that contained a 
syllabus, descriptions of the various assignments, information on grading, etc. Because this space 
already existed and would only need modification, there was no discussion of not using it again. 

The one area of this OELE that was different for this delivery was the inclusion of all 
course supporting materials on the website. In prior offerings we had required a rather extensive 
set of readings that included articles on the issues of integration, articles on different uses of the 
Internet in the classroom, issues of grading, and articles on policies, rights, and evaluations. As a 
service to the university a local bookstore took care of copying, getting copyright permissions, 
and binding the materials. They were also willing to distribute the books to the students who 
called from around the world. In our 16-week courses, this had been an acceptable arrangement 
because the students could access much of the readings for the first two or three weeks on the 
web in various places while readings packet was in transit However, in a three-week course, this 
delay would have been devastating. Because there was no way to contact our students before the 
course began (an administrative issue), our only option was to use an all-online support system. 
This meant that in addition to building the problem and updating the website, we also had to 
provide a fairly extensive library of support materials for the students. 3 

Finally, we concluded the design phase by examining the evaluation plan. We outlined a plan 
that respected the process and the outcomes. Grades covered three main components. Students 
received 30% of their grade from participating in the web-based discussions with their teams and 
the larger class; 35% of their grade was based on their individual contributions to their team’s 



3 Our past experience indicated that asking students to find a significant portion of their materials on their own cased 
considerable frustration and yielded only limited success as many of the students simply did not have the search 
skills or time available to fins appropriate materials. That is why at least a portion of the materials needed to be 
provided. 
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efforts; and the final 35% was designated for the product produced as the outcome for the 
problem. Specifically, we chose to consider the following aspects : 

• Report addresses issues relevant to Jefferson County Schools' integration of technology 
(40 points) 

• Report provides support and examples from other resources (research and projects) (30 
points) 

• Report provides some clear proposals for the superintendent (20 points) 

• Report is professionally written ( 10 points) 

Even with this plan in place there was much in the implementation phase that went into the final 
evaluation. The grades were negotiated by both instructors at the end. 

Development & Evaluation 

The development of the problem very much became intertwined with the design, 
implementation, and evaluation of the OELE. There were several issues in the development 
phase that are typical to any PBL situation, such as identifying and considering how to present 
resources. We had some added developmental elements because of the medium we were working 
in such as creating the materials in a way that they could be delivered over the web. 

The first step in the development was to create the problem. Both instructors agreed that 
the problem should deal with a grant and should focus on technology integration in a meaningful 
way because those were authentic problem areas for teachers to work with. 4 One instructor, 
Orrill, took primary responsibility for the problem development. Kirkley served as a subject 
matter expert in an informal “connoisseur-based” formative evaluation (Kemp, Morrison, & 
Ross, 1998). The problem slowly evolved from a federal education grant request for proposals 
that had been found on the web. The grant application was altered to support the ideas we felt 
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